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AMENDMENT UNDER 37 C.F.R. §1.111 
Appln. No.: 09/916,210 

AMENDMENTS TO THE CLAIMS 

This listing of claims will replace all prior versions and listings of claims in the 

application: 

LISTING OF CLAIMS: 

1. (original): An object activity modeling method comprising the steps of: 

(a) obtaining an optical flow vector from a video sequence; 

(b) obtaining the probability distribution of the feature vector for a plurality of video 
frames, using the optical flow vector; 

(c) modeling states, using the probability distribution of the feature vector; and 

(d) expressing the activity of the object in the video sequence based on state transition. 

2. (original): The object activity modeling method of claim 1, wherein the step (a) is 
based on affine motion estimation. 

3. (original): The object activity modeling method of claim 2, wherein the step (a) 
further comprises the sub-steps of: 

(a-1) grouping input video frames into a plurality of video frame groups and dividing 
each video frame group as an individual state; 

(a-2) obtaining an affine motion parameter for each video in the video frame group of 
each individual state; and 

(a-3) obtaining an optical flow vector from the affine motion parameters. 
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4. (original): The object activity modeling method of claim 3, wherein the step (a-2) 
comprises a step for determining parameters, which minimizes summed square difference 
£ (I t (x) - I t _! (x - V(x))) 2 over a given video based on the intensity of the pixel on the object, 

which is expressed as I t (x)=I t _i(x-V(x)) when I denotes intensity, t denotes time, x denotes a pixel 
location (x, y), and v denotes the motion vector, as motion parameters. 



5. (original): The object activity modeling method of claim 1, wherein the step (b) 
comprises a step for calculating probability distribution P(Z|Q) by the following equation: 



exp(--(z-m) T )Q" 1 (Z-m)) 
P(Z|Q)= 2 



1 1 / 2 



(2ti) n |Q| 

wherein P=(pi,p2, ... Pd) denotes a motion vector calculated at each pixel location (x, y), L 
denotes the number of pixels in a video frame or a region of interest, d denotes the number of 
dimensions, feature vector Z, which is a d x L dimension vector, is 

Z = (pl,pf,...,p 1 L J p 1 2 ,P2v.. 5 P2,Pd,PdvPd) T » mis the mean vector of feature vector Z, and Q is 
the covariance matrix of feature vector Z, and it is assumed that feature vector Z is provided 
from observation class £2. 

6. (original): The object activity modeling method of claim 1, wherein the step (b) 
further comprises the steps of: 

decomposing covariance matrix Q as the following equation: 
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Q=3> A<t> T 

A 

Wherein Z is equal to Z-m, the columns of $ are orthonormal eigenvectors of 
covariance matrix Q, and A corresponds to the diagonal eigenvalue; and 

calculating probability distribution P(Z\Q) by the following equation: 

1 A ' 

Z Ki+\ 

(2*p) { "- MV2 

wherein M is the number of principal components, y\ is the i-th component of Y, a* is the 

1 N 

i-th eigenvalue of Q, and p is the optimal value, which is obtained by p = — — — ^ctj , and it is 

N — M M+1 

assumed that feature vector Z is provided from observation class Q. 

7. (original): The object activity modeling method of claim 1, wherein in the step 
(c), the object activity in the video sequence is expressed using a Hidden Markov Model 
(HMM), based on state transition. 

8. (original): The object activity modeling method of claim 7, wherein the Hidden 
Markov Model (HMM) is expressed as A={S, A, B, 11} when N is the number of possible states, 
S satisfies E = {qi, q 2 , ...» qrv}, A is {ay}, the transition between hidden states i and j, B is {bj(.)}, 



I K4 



P(Z|Q)= 



ex P(" 2^ 



(2*HM 



1/2 
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the observation symbol probability corresponding to state j, and n is the initial state distribution, 
and the state E = {qi, q 2 , qrvi} and the initial state distribution n are determined in advance 
based on video data. 

9. (original): An object activity recognition method comprising the steps of: 

(a) obtaining feature vectors by motion estimation for video frames; 

(b) determining a state, to which each frame belongs, using the obtained feature vectors; 

and 

(c) determining an activity model, which maximizes the probability between activity 
models and a video frame provided from a given activity model dictionary using a transition 
matrix for the determined state, as the recognized activity. 

10. (currently amended): The object activity recognition method of claim 9, wherein 
the step-(d)_[c] comprises a step of finding an activity model, which maximizes probability 
?(0\X) from the given activity model dictionary [X u ^2, • ^e}, when T is a positive integer 
indicating the number of frames forming the video sequence, Zj, Z 2 , Z T are feature vectors of 
first frame, second frame, T-th frame, respectively, and if video frame 0={Zj, Z 2 , Z T } is 
given and E is the number of state models. 
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11. (original): The object activity recognition method of claim 10, wherein the 

transition matrix is obtained by using an expectation-maximization (EM) algorithm based on the 

observation symbol probability {bj(.)} corresponding to scene j in the training process. 
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